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Abstract 

We construct a patchy feedback for a general control system on R" which realizes practical 
stabilization to a target set E, when the dynamics is constrained to a given set of states 
S. The main result is that 5-constrained asymptotically controllability to E implies the 
existence of a discontinuous practically stabilizing feedback. Such a feedback can be con- 
structed in "patchy" form, a particular class of piecewise constant controls which ensure 
the existence of local Caratheodory solutions to any Cauchy problem of the control system 
and which enjoy good robustness properties with respect to both measurement errors and 
external disturbances. 
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1 Introduction 

Consider a general control system 

x = f(x,u) xeR d , (1) 

where the upper dot denotes a derivative w.r.t. time, u is the control taking values in a compact 
set U CC M. m and / : M. d x U — > M. d is a vector field satisfying the following properties 

(Fl) / is continuous on R d x U and Lipschitz continuous in the variable x, uniformly for 
u £ U, i.e. there exists a constant Lf such that 

\f(x,u) - f(y,u)\ < L f \x - y\ , 

for all (x,u) and (y,u) in R d x U. 

(F2) / has sub-linear growth, i.e. 

\f(x,u)\<C f (l + \x\) VxeR d , (2) 

for some constant Cf independent on u. 
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(F3) The set of velocites 

f(x,V) = {f(x,u) ;ue\J} 

is convex for every x € M. d . 

In this article, we want to address the problem of stabilizing trajectories of (TIJ towards 
a target set E C M. d in the case of a dynamics constrained inside a prescribed set S C M d . 
In particular, we aim to construct a feedback control U = U(x) which realizes stabilization 
to a neighborhood of E and which is robust enough to provide the same stabilization also in 
presence of inner and outer perturbations of the dynamics, such as measurement errors and 
external disturbances. 

However, one has to be careful because, even in very simple problems without state constraints, 
one cannot expect the existence of continuous control feedback laws which steer all trajectories 
towards a target E and stabilize them [HJ [TBI IE] • The lack of continuity in the feedback control 
creates quite a big theoretical problem, because continuity of U (x) is a minimal requirement 
to apply the classical existence theory of ordinary differential equations to the resulting closed 
loop system 

x = f(x,U(x)). (3) 

Therefore, in cases where discontinuous feedback laws have to be used, one has either to choose 
a generalized concept of solution or to verify that classical solutions still exist when a certain 
discontinuous law is used. 

In order to precisely state our results, we need to first introduce a few definitions and notations. 
Namely, we denote with |x| the Euclidean norm of any element x 6 R d and with 

B d = {x e R d ; |.t| < 1} 

the open unit ball of M. d . Also, given any set E C K d , we denote its convex hull with co(E), 

o 

and its (topological) closure, interior and boundary respectively with E, E and dE, so that e.g. 

o 

we have Bd = Bd, dBd — {x e M. d ; \x\ = 1} and Bd = BjU dBd- Finally, we use the notation 
v • 4> for the directional derivative of a function <j) along the direction v, i.e. 

v.Hx)^lim^ X + tv) -^ X) . (4) 

Given a feedback control u(x), we recall that for a system of differential equations like (jTJ) with 
initial datum x(0) = x , a Caratheodory solution on some interval / is an absolutely continuous 
map 1 1— ?• x(t) which satisfies (fTJ for a.e. t £ I, i.e. satisfying the integral representation 

x{t)=x +[ f{x(s),u(x(s)))ds ytel. (5) 
Jo 

Definition 1.1 Given a bounded constraint set S C K d and a target set E C M. d such that 
iSflE ^ 0, we say that the system UJ) is open loop S'-constrained controllable to E if the following 
holds. For any initial state x € S, there exists a Lebesgue measurable control function u(-) and 
a time T = T(x ,u) > such that denoting with x(-) the Caratheodory solution, corresponding 
to the control u, of the Cauchy problem for (jTJ) with initial datum x(0) — x , one has 

x(t)eS Vie[0,T], 

and 

x(T) e E . 
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Definition 1.2 Given a bounded constraint set S C M. and a target set £ C M such that 
S H E ^ 0, we saj/ i/iai a feedback control U : dom J7 — > U, defined on some open domain dom £/ 
which contains 5 f \E, is iS-constrained stabilizing to S m Caratheodory sense for the system (JTJ) 
j/ the following holds. For any initial state x G S , the closed loop system §3§ with initial datum 
x(0) = x admits Caratheodory solutions and, moreover, there exists T = T(x a ) > such that 
for any Caratheodory solution x(-) to §3§ starting from x one has 

x{t)eS Vie [0,T max [, 

and 

ar(t)GS Vi G [T,T max [, 

where we denoted by T max = T max (x ,U) the maximal time of existence ofx(-). 

One has to be careful when dealing with Definition [T72J Indeed, as we have already stressed, 
in general there might fail to exist a continuous feedback law U(x) which stabilizes |T|). Hence, 
one has to consider discontinuous feedback controls, but in such a case there might be no 
Caratheodory solutions at all. 

To cope with this problem, we choose here to consider a particular class of feedback controls, the 
so called patchy feedbacks [TJ [3l [7] , which are piecewise constant and such that the resulting 
control system Q always admits local Caratheodory solutions for positive times. 
We remark that this is not the only possible approach to deal with discontinuous control laws. 
Indeed, one could allow for arbitrary discontinuous feedback controls u = u(x) and replace 
Caratheodory trajectories with a weaker concept of solutions. In recent years many authors have 
followed this alternative path by considering sample-and-hold solutions and Euler solutions for 
discontinuous vector fields (see e.g. [10]) and several results have also been obtained in the 
context of constrained dynamics (see [111 1121 113p. However, with this approach, in order to 
guarantee that the resulting control is robust with respect to both inner and outer perturbations, 
without chattering phenomena, it is necessary to impose additional assumptions on the sampling 
step of the solutions considered. On the contrary, patchy feedbacks allow to consider classical 
Caratheodory solutions and do not require any additional hypothesis to be robust, thanks to 
their regularity which ensures that only "tame" discontinuities are present in the dynamics. 

Let us introduce now the assumptions on the constraint set S. First we recall a notion from 
non-smooth analysis [lOj : given a closed set S in R d and a point x G S, the Clarke (proximal) 
normal cone to S in x is defined as the set 

Ng(x) = |aC ; A>0, £eco ^{0} U |« = lim ^- ; Vi ± S in Xi , Xi x^j j , (6) 

where "d, _L S in a;," means that Uj + x% ^ S and Xi belongs to the projection of i>; + Xi on S, 
or equivalcntly 

Vi + Xi 4l S and \vA = inf lu, + Xi — £1 . 

We are now ready to state the main hypotheses on S : 

(51) S is compact and wedged at each x G dS. The latter means that at each boundary point 
x one has that Ng(x), the Clarke normal cone to S in x, is pointed; that is, 

Or) n {-JVf (x)} = {0} . 

(52) The following "strict inwardness" condition holds: 

min f(x, u) ■ p < , 

for all x G dS and p G N§(x) \ {0}. 
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Notice that, in Definition 11.11 wc do not assume stability of the target set, i.e. we are not 
requiring that trajectories starting sufficiently close to E always remain close to E. Hence, in 
general we do not expect a feedback which stabilizes the dynamics precisely to the target. The 
main result of this paper concerns instead practical stabilization of fTJ) to S, i.e. the existence 
for all 5 > of a patchy feedback control which stabilizes trajectories of (JTJ) to a neighborhood 
E" 5 = S + 5B d of the target set. 

Theorem 1 Assume that the system (|TJ) satisfies (F1)-(F3) and open loop S -constrained con- 
trollability to E, where S is a set satisfying (SI) and (S2) and E is any closed set such that 
S n E 7^ 0. Then, for every 5 > there exists a patchy feedback control U = U{x), defined on 
an open domain T> with S\T, S C T>, which is S -constrained stabilizing to E 5 for (fTj). 

Under assumptions (SI) and (S2) on the constraint set, it was proved in [TJ] that it is 
possible to construct a discontinuous feedback control which steers Euler solutions of Q to E 5 . 
However, as mentioned above, when a patchy feedback exists more robustness properties can be 
expected to hold than in the case of the generic feedback presented in [TJ] . This indeed happens 
also for the constrained problem considered here, and we will show that practical stabilization 
of perturbed systems can be established as well. We refer to Section 16.31 for the result about 
perturbed systems and for further discussions about robustness of the control provided by 
Theorem [TJ 

It is worth to mention that in the process of constructing the required feedback controls, 
we also prove two technical Lemmas 13.11 and 13.21 whose applications extend beyond the specific 
usage in this paper. They offer, indeed, general procedures to construct patchy feedbacks 
starting from semiconcave functions and wegded sets, respectively, and hence represent powerful 
mathematical tools on their own. An example of application of Lemma 13.11 is presented in 
Section r6.41 where wc give a new proof of a result by Ancona and Bressan [T] about the existence 
of a stabilizing patchy feedback for systems with unconstrained dynamics |T]) which arc GAC 
to the origin. 

2 Preliminiaries 

2.1 Patchy vector fields and patchy feedbacks 

We start by recalling the main definitions and properties of the class of discontinuous vector 
fields (patchy vector fields) introduced in [T] . 

Definition 2.1 We say that g : —> M. d is a patchy vector field on the open domain fl C R d 
if there exists a family {(Q a ,g a ) ; a £ A} such that (see Fig. 1) 

(i) A is a totally ordered set of indices; 

(ii) each f2 a is an open domain with smooth boundary; 
(Hi) the open sets £l a form a locally finite covering ofQ; 

(iv) each g a is a Lipschitz continuous vector field defined on a neighborhood ofQ a , which points 
strictly inward at each boundary point x £ dfl a : namely, calling n(x) the outer normal at 
the boundary point x, we require 

g a (x)-n(x)<0 Mx£dVl a ; (7) 
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Figure 1: A patchy vector field. 



(v) the vector field g can be written in the form 

g(x)=g a (x) if x G ti a \ (J tip. 

I3>a 

Each element (ti a ,g a ) of the family is called patch. 
By defining 

a* (x) = max {a £ A ; 
the identity @ can be written in the equivalent form 

9i x ) = 9 a , M (x) Vxeti. 



(8) 



(9) 



(10) 



We shall occasionally adopt the longer notation (ti, g, (ti a , g a ) aeA ) to indicate a patchy vector 
field, specifying both the domain and the single patches. 

Remark 2.1 Notice that the smoothness assumption on the boundaries dti a in (ii) above can 
be relaxed. Indeed, one can consider patches (ti a ,g a ) where the domain ti a only has piecewise 
smooth boundary. In this case, the inward-pointing condition ((7|) can be rephrased as 

g(x)eT n (x), (11) 
Tq(x) denoting the (Bouligand) tangent cone to ti at the point x, defined by (see 11 Of) 



, d(x + tv, ti) 
T n (x) = {v 6 R d ; liminf ■ — >- = 

*4.o t 



(12) 



Clearly, at any regular point x G dti, the interior of the tangent cone Tq(x) is precisely the set 
of all vectors v € M. d that satisfy v ■ n(x) < and hence (fTTj) coincides with the inward-pointing 
condition (|7|). 



Remark 2.2 Notice also that in Definition \2A\ the values attained by g a on ti a n tip for any 
j3 > a are irrelevant. Similarly, the inward pointing condition {7} does not really matter in 
points x G dti a (Itip, for any (3 > a, and in points x G dti a f] (M d \ ti). This is a consequence of 
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the fact that, in general, the patches (fi a , g a ) are not uniquely determined by the patchy vector 
field g. 

Indeed, as observed in JI]/ ; whenever a Lipschitz vector field h a is given on Q a so that it veri- 
fies ([7]) on (dQ a H 0) \ U/3>q ^P> one can always construct another Lipschitz vector field g a on 
Q a such that g a = h a on (fl a fl fl) \ [Ja >a £1/3 and such that Q is verified at every x G dfl a . 

If g is a patchy vector field, the differential equation 

x = g(x) (13) 

has many interesting properties. In particular, it was proved in [T] that, given any initial 
condition 

x(0) = x , (14) 

the Cauchy problem (fl~3"]) -([T4" |) has at least one forward solution, and at most one backward 
solution in Caratheodory sense. We recall that a Caratheodory solution of f| 13[) (fl^|) on some 
interval / is an absolutely continuous map £ i — 5- T(t) which satisfies (Ti~3"|) for a.c. t E I, i.e. 

j(t) = x + f g{j{s))ds Vie/. (15) 
Jo 

We collect below the other main properties satisfied by trajectories of (fT5|) — (fT^j) . 

• For every Caratheodory solution 7(-) of (|13f) . the map 1 1-4 a* (7(i)), with a* the function 
defined in ([9]), is left continuous and non-decreasing. Moreover, it is piecewise constant 
on every compact interval [a, b], i.e. there exist a partition a = t Q < t\ < . . . < t^ = b of 
[a, b] and indices a± < . . . < ajy in -4 such that a*(7(i)) = on for all t £ ]£j— i, U]. 

• The set of all Caratheodory solutions of (fT3")) - (fT4"|) is closed in the topology of uniform 
convergence, but possibly not connected. 

• Caratheodory solution of ()13[) are robust w.r.t. to both inner and outer perturbations; 
namely, for any solution y(-) of the perturbed system 

y = g(y + + d , 

there exists a solution x(-) of the unperturbed system (TTJ) such that ||x — is a s small 

as we want, provided that £ and d are small enough in BV and L 1 , respectively (see [5] 
for the details in the general case, and Section [S] for a discussion of the constrained case). 

The class of patchy vector fields is of great interest in a wide variety of control problems 
for general nonlinear control systems (JTJ) , that can be solved by constructing a state feedback 
u = U{x) which renders the resulting closed loop map g{x) = f(x,U(x)) a patchy vector field 
and, hence, ensures robustness properties of the resulting solutions without additional efforts. 
This leads to the following definition. 

Definition 2.2 Let A be a totally ordered set of indices, and (/7 a ) ae ^ be a family of control 
values in U such that, for each a 6 A, there exists a patch (fl a ,g a ) which satisfies 

g a (x) = f{x, U a ) Vx€Q a \|JiV (16) 

fi>a 

If the family {Q a } a eA form a locally finite covering of the set [J a ^^^a, then the piecewise 
constant map 

U(x) =U a if x e Q a \ |J (17) 
is called a patchy feedback control on U Q e.A 
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By requiring (|16p with (Q a ,g a ) being a patch, in particular we require that 
f{x, U a (x)) ■ n(x) < Vx€dn a \{J tip. 

By Definitions 12.11 [2721 it is thus clear that, given a patchy feedback U, the corresponding col- 
lection of patches (Cl a ,g a ), a E A, defines a patchy vector field g(x) = f(x, U(x)) on IJae^i ^a- 
Moreover, recalling the definition of a*(x) in a patchy feedback control can be written in 
the equivalent form 

u(x) = u a , (x) (x) xen=\Jn a . (is) 

We shall occasionally adopt the longer notation (U, (f2 a , U a )aeA) to indicate a patchy feedback 
control, similarly to the notation adopted for patchy vector fields. 

Remark 2.3 As in Remark \2.S\, the values attained by U a on the set Q a n fig are irrelevant, 
whenever a < (3, and similarly it only matters that f(-,U a (-)) fulfills the inward-pointing con- 
dition © at points of (dfl a l~l Q) \ 1J^ >Q , fi/3. 

Finally, we recall the definition of the lexicographic order on a set of /c-tuple indices. Given 
a = (oi, . . . , Cfc) and a' = (a[, . . . , a' k ), we say that a -< a' iff 

-i ■ r-, >i i ,i f = °i for alii < ? , 

3 j e{l,...,fc} such that | ^ < ^ J ' (19) 

2.2 Wedged sets and inner approximations 

In this section we collect a few geometrical properties which are satisfied by either any wedged 
set or specifically by sets for which both (SI) and (S2) hold. As a first step, we want to give 
a characterization of wedged sets. 

We start by recalling the definition of Clarke's tangent cone to S in x, which we denote by 
Tg(x), as the polar cone to the normal cone Ng(x) defined in that is 

T s 0) = { v e Rd ; P ■ v < V P e N s( x )} ■ (20) 

In general, the Clarke tangent cone is smaller than the Bouligand tangent cone defined in (1121) 
(see [E|), i-e. there holds for every closed set S and every z £ S 

lf(z) C T s (z). 

o 

For later use, we recall that whenever A, B C R d with A wedged, z e Af\B and T%(z)CiT^(z) ^ 
0, one can prove (see [TB]) that 

Tf(z) n T£(z) C T? nB (z) C T AnB (z). (21) 

Moreover, for all v € M. d and £ > we call wedge of axis u and radius e the set (see Figure [5] 
left) 

W(u, e) = {sw ; w ev + eB d , s <E [0, e]} . 

Finally, to denote the "lower" part of the boundary of a wedge (see Figure fright), we use the 
following 

d~W(v, e) = {ew ; w e v + edBd, (v — w) ■ v < 0} . 
We are now in a position to state the following characterization result. 
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W(v,e/2) 



v+eBd 



W(v,e) 



Figure 2: Left: Wedge W(v,e), of axis v and radius e. Right: The "lower" boundary 
d~W(v, e/2) of the smaller wedge is strictly separated from M. d \ W(v, e). 

Proposition 2.1 Let S C M. d be a closed nonempty set and x G dS. Then, the following 
properties are equivalent: 

(i) S is wedged in x; 

(ii) Tg \x) has nonempty interior; 

(in) there exist v £ M. d and e > such that 



We refer to [TU] for the proof of the equivalences above. We also mention that wedged sets 
are sometimes called epi-Lipschitz sets because they are locally the epigraph of a Lipschitz 
continuous function (see [15]). 

For later use, we need a better understanding of the behavior of wedges when their radii are 
rescaled. It is immediate to deduce from the definition that W(v,e/2) C W(v,e) for every 
v € M. d and e > 0. Moreover, we claim that points of the "lower" boundary z G 9 _ W(w,e/2), 
are well inside the larger wedge W(v,e) (see again Figure [2] right). Indeed, it is not difficult to 
verify that for any fixed v G M. d and any z G d~W(v, e/2), there holds 



Next, we collect a few results concerning the "inner approximations" of a set S satisfying 
(SI) and (S2). Given a closed set 5* and r > 0, we call r-inner approximation of S the set 



y + W(v,e) c S 



Vye{x + eB d } n S . 



£ 



< d(z,R d \W(v,e)) < £0(1). 



(22) 



0(1) 



S r = {x G R d ; d(x, R d \ S) > r} , 



(23) 



and wc define 



o 



Q(S,r) = S\S r . 



(24) 



Given x G 5*, we also set r(x) = d(x,M. d \ S). 
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Lemma 2.1 (Lemma 3.3 in [llj) Let S be a set such that (SI) is verified. Then there exists 
r a > such that for all r G [0, r ] the set S r is nonempty and wedged in every point of its 
boundary. 

Observe that in terms of Clarke's tangent cone (fiZH]) to a closed set S, condition (S2) can be 
restated as follows. For every x G dS there holds 

Tf(x)n/(x,U)/0, 

i.e. (S2) ensures that there is an admissible speed pointing strictly inside the set S. In fact, next 
lemma shows that, by combining properties (SI) and (S2), it is possible to prove a stronger 
property. 

Lemma 2.2 (Lemma 3.5 in [llj) Assume that f in Jl} satisfies (F1)-(F3). Let S be a set 

such that (SI) and (S2) are verified and r D > be the value found in Lemma \2.1\ Then there 
exist /! > and a Lipschitz continuous function v: Q(S,r a ) — > M. d such that 

v{x)ef{x,XJ) VxeQ{S,r ) (25) 

and 

v{x) + fxB d c Tf rW (x) Vie Q(S, r Q ) . (26) 

Notice that Lemma |2~21 makes explicit use of the convexity hypothesis (F3) on the vector field, 
in order to obtain (|2"5j) . Also, one can deduce from wedgedness of S and (f!?6")) that v(x) ^ for 
all x G R n . 

Lemma 2.3 (Lemma 3.6 in [llj) Assume that f in |T]) satisfies (F1)-(F3). Let S be a set 

such that (SI) and (S2) are verified, r a > be the value found in Lemma \2. 1\ and v : Q(S,r ) — > 
M. d the Lipschitz continuous function found in Lemma \2.2\ Then there exists e > such that 
for every x G QiS, r a ) one has 

y + W(v{x), e) C S r{x) V y G {x + sB d } n S r(x) , 

y + W(-v(x), e) C R d \ S r{x) V y G {x + eB d } \ S r(x) . 

Lcmma l2 . 31 provides uniformity of the radii of wedges with axis v(x) which are contained in each 
inner approximation S r t x y Moreover, it implies that v(x) is in the interior of the Clarke tangent 
cone T s c ^(x) for all x G Q(S,r ). While this result is not completely surprising, it shows all 

its importance when combined with the following one, dealing with decrease properties of the 
signed distance function. We recall that, given a closed set Z C M. d , the signed distance of a 
point x G R d from Z is given by 

A z (x) = d{x, Z) - d(x,W\Z) . 

It is not difficult to verify that the function Az is Lipschitz continuous. 

Lemma 2.4 (Lemma 3.7 in [llj) Let S be a closed set which is wedged at x G dS. Assume 
v G R d and e > are such that 

y + W(v,e)cS V y G {x + eB d } n S , 

y + W(—v, e) cW\S V y G {x + eB d } \ S . 

Then there exists a neighborhood J\f x of x such that 

VA s (y) -v < -e, 

for all y G Af x \ dS in which As is differentiable. 
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2.3 Strong CLF families 

In this section we recall the definition of strong CLF family related to a control problem with 
constraint S and target E, as introduced in |13| . and its main properties. As before, we use in 
this section the notation 

E* 5 = E + SB d , 

for any S > 0. 

Definition 2.3 A strong control Lyapunov functions family (or strong CLF family,) w.r.t. S 
and E is a family of functions {<£> 7 (-)} for which there exist e > and C > such that for every 
7 > the following properties hold 

(i) tp-y is Lipschitz continuous and locally semiconcave on S + sB^; 

(ii) for every x £ {S + sBd} \ E 2 t in which <p 7 is differentiable, one has 

min WipJx)-w < -C , (27) 

toe t 

where T = T%{x) n f(x, U) if x £ dS and T = f(x, U) if x <£ dS; 
(Hi) ipy > on S \ Et and ip^ = in S n Et. 

The main result we need is the following proposition that can be deduced from the proof of 
Theorem 4.1 in [T^] (see also the characterization theorem given in Theorem 2.3 of [T3], in the 
case of finite time controllability). 

Proposition 2.2 (Clarke &: Stern [12J ) Assume that f in (TTJ) satisfies (F1)-(F3) and that 
S satisfies (SI) and (S2). If the system (fTJ) satisfies open loop S -constrained controllability to 
E then the system (JTJ) admits a strong CLF family w.r.t. S and E. 

In particular, such a family {ip-y} can be chosen so that the following holds. Let r a > be the 
value found in Lemma \2.1[ v: Q(S,r a ) — > M. d be the Lipschitz continuous function found in 
Lemma \2. 6 A and C the constant in (|27[) . Then, for all 7 > there exists r 7 G ]0, r a ] such that 

V^(x)-v(x) <--, (28) 
for all x £ Q(S,rj) in which <py is differentiable. 

In fact, one can require inequalities ((27)) and (j28|) to hold also in points where <p 7 is not differen- 
tiable, by replacing V(^ 7 (s) with any vector in the limiting subgradient of tp-y in x (see jlOj for 
a precise definition of generalized gradients and their properties in the context of non-smooth 
analysis). However, in view of Lipschitz continuity of the functions ip^ and of Radcmacher's 
theorem, the set of points M where V<p 7 does not exist is Lebesgue negligible and, for the results 
we want to prove in this paper, it is enough to work outside N. 

3 Fundamental Lemmas 

We collect in this section two lemmas which provide the key ingredients for the proof of Theo- 
rem [T] Namely, these results offer a general procedure to construct a patchy feedback whenever 
there exists a semiconcave function which decreases along trajectories of |T]), or whenever we 
are close to the boundary of a set which satisfies (SI) and (S2). 
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It should be noted that the procedure outlined in Lemma l3~Tl strictlv follows the one exploited 
in [7] to construct a nearly optimal control for an unconstrained dynamics. 
Anyway, the present formulation is more general since it makes no use of any specific fea- 
tures of the optimality problem and therefore it offers a flexible and effective tool to construct 
patchy feedbacks for general problems, well beyond the specific applications treated here. For 
completeness sake, the proof of this lemma is included in the Appendix. 

Lemma 3.1 Assume that f in ^ satisfies (Fl) and (F2). Let C R d be a set, V : SI — > 
[0, +og[ be a locally semiconcave function on SI and h: M. d — > [0, +oo[ be a continuous function 
such that 

mm{VV(x) ■ f(x,u)} + h(x) <0, (29) 

for all x £ where VV(x) is defined. Then for every bounded set A CC SI, every p > and 
every < e < max-rh(x), there exist a continuous function W: ~R. d — > [0, +oo[ and a patchy 
feedback control U : T> — > U, with D D A \ £ and £ D {x G A ; h(x) < e}, such that the 
following properties hold. 

(i) W(x) is the pointwise minimum of a finite family of quadratic functions W\ , . . . , W q : R d — > 

[0,+oo[ defined by 

Wi{x) = k\x - Xi\ 2 + Ti , i=l,...,q, (30) 

for suitable Xi € M. d , r, gR and a common constant k > 0, and W satisfies 

V(x) < W(x) < V(x) +p, (31) 

for all x £ A. 

(ii) For all x G T>\£ one has 

f(x, U(x)) • W(x) + h(x) < e . (32) 

where the symbol " stands for the directional derivative, as in ((?]). 

Moreover, one can require that the following additional properties hold. 

(Hi) For every A > 0, the function W can be constructed so that, for every x G A and every 
j G {1,. . .,</} such that W(x) = Wj(x), there exists yj G A where V is differ entiable and 

\x- yj \<\, |W(y 3 -)-V^(i)|<A. (33) 

(iv) For every X' > 0, the patchy control U = (U, (fl a ,U a ) a ^^) can be constructed so that it 
satisfies diami7 Q < A' Va G A. 

Remark 3.1 Notice that the assumptions on f in Lemma \3.1\ can be actually relaxed to mere 
boundedness and uniform continuity on the set A x U. Also, if h is bounded below by a positive 
constant c, then for e < c the choice £ = is allowed, i.e. for e > small enough the 
corresponding patchy feedback U can be defined in the whole compact A. Finally, any change of 
the parameter A' > in (iv) only affects the patchy control, while the function W requires no 
modification. 
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The result in Lemma T3. II can be summarized as follows: given a semiconcave function V such 
that (|29p is satisfied and a bounded set A, we can always provide a smoother approximation 
of V over A, in terms of a piecewise quadratic function W which makes |W — V| as small as 
we want, and we can construct a patchy feedback U such that W satisfies ([52"]) . which is an 
approximate version of (|29|l . Additionally, the construction can be required to satisfy properties 
(in) and (iv): namely, we can choose W so that if W = Wj, then VW^ is close to VV evaluated 
in a nearby point and the domains Q a which constitutes U can be taken as small as we want. 

Now, we introduce the second result needed by Theorem [TJ i.e. a lemma dealing with the 
construction of a patchy feedback control U(x) near the boundary of a wedged set S so that S 
results positively invariant for the resulting dynamics ©. Notice that the sets S r and Q(S,r), 
for any r > 0, have been introduced in (|23 p — (|24 [1 and that for any x € S we use r(x) to denote 
the quantity d(x,Hl d \ S), as in Section [5] 

Lemma 3.2 Assume that f in ^ satisfies (F1)-(F3) and that S satisfies (SI) and (S2). Let 
r a > be as in Lemma[2J[ v: Q(S,r ) ->• R d be as in Lemma \2.2\ and e be as in Lemma \2.3i 
Then, for all r £]0,r o [ and all e g]0,£/2[, there exists a patchy feedback control U:T>—¥\J, 
with 

Q{S,r)CVCQ(S,r) + {r -r)B~ d , (34) 
such that for all x € Q(S,f) there hold 

\f(x,U(x))-v(x)\<e, (35) 

y + W(f(x,U(x)),e) C S r{x) V y e {x + iB d } n 5 r(a:) , (36) 

?y + W(-/(.T,C/(x)), £ ) c M d \5 r(a) Vye{x + £B d }\S r(l) , (37) 

Moreover, one can require that for every A > the patchy control U = {U, (O a , C^ Q ) Q6 ^) satisfies 
diamfi Q < A and VL a n r G ) ^ 0, Va £ ^. 

This lemma allows to construct a patchy control U, defined on the whole Q(S,f), such that 
wedges of axis f(x, U(x)) and uniform radii are contained in each inner approximation S r r x y In 
particular, by applying Lemma [2^41 to the vector v = f(x,U(x)), to the wedged sets S r ( x ) and 
to the point x G dS r r x \, conditions (|3"6"|) and ([3T|) imply that there exists a neighborhood J\f x of 
a; such that 

VA SrM (y)- f(x,U(x)) <-e <0, (38) 

whenever y £ J\f x is a point of differentiability of the map ^ i— > A5 r(:r) (^). 

In the applications to systems whose dynamics is constrained to a wedged set S, it should 
now seem quite natural to proceed as follows: we adopt the construction provided by Lemma [3. 2 1 
in the region Q(S, f) which is near the boundary dS; and we use a different construction, based 
on Lemma 13.11 to deal with the region Sr, which is the part of S sufficiently far from OS. 
However, Lemma 13.11 does not keep explicitly track of the location of trajectories, and hence 
the domain D of the resulting control might well be larger than the constraint set S. 
In order to actually piece together the dynamics given by the different feedbacks in Q(S, f) and 
Sf, so that they can be combined into an ^-constrained stabilizing patchy feedback defined in 
the whole set, the following will be useful. 

Remark 3.2 In the same settings of Lemma \3.1l there exist a constant a > and, for any 
compact sets K C A\£ , a totally ordered set of indices B C A such that the following properties 
hold 
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(i) K C |J Sip C K + X'B d ; 

(ii) setting M* = maxjW, m* = xnhij^W, N = l M "~ m ' \ + 1 and 

C m = {x 6 R d ; M* - (to + l)cr < W(x) < M* - ma} m G {0, . . . , N - 1} , 
i/iere ezisi indices /3 < . . . < /3jv in B such that B — {j3 ; P < j3 < (3n}? 

A'fl£ m C (J fy, (39) 

pee 

and for any fixed [3 € B, if f3 m < j3 < fi m +\ then one has 

f(x, U p {x)) ■ n{x) < VxedQp\l\J Q p , U |J £ ro - . (40) 

\f)'>P m'>m J 

In other words, given a compact set K C A \ £ we can extract, from the family of domains 
{Q a } a eA used to construct U, a subfamily {Qp}fieB which provides a covering of K contained 
in a A' -neighborhood of K . Moreover, the resulting subfamily can be described in more detail 
by considering the sets K n C m , with m G {0, . . . , N — 1}, which are uniform slices of the set K 
w.r.t. sublevel sets of the function W . Namely, the family {r^j^gg is ordered so that, for all 
m, the elements {Qp} covering KC\C m have smaller indices f3 than the elements {Qp 1 } covering 
KnC m +i; and the vector field corresponding to the "extracted" control U = (U, (Sip, Up)p^B) is 
inward pointing on each dQp as long as we haven't entered a patch or a slice with larger index. 
It is worth noticing that such a procedure does not require any change to the original construction 
of W and U. Anyway, the choice of the subfamily (flp,Up)p e s instead of (Sl a ,U a ) a ^j, has a 
drawback: in general the resulting control U is only patchy on the domain U/3eB an d ^ e 
inward pointing condition might fail in points of the set 

I 



o p , m . = (dQpn£ m ')\ 



k u |J n 



P'eB 



for p m < (3 < fim+i and to' > m. 

Remark 3.3 In Lemma \3.1l the requirement of W being the pointwise minimum of a finite 
family of quadratic functions means that its level sets are contained in a finite union of spheres. 
As a result, also the boundaries of the slices C m in Remark V3.°A which are sets of the form 

{W = c m } = {x G R d ; W(x) = c m } , 

are contained in the union of a finite number of spheres. We now claim that, up to a slight 
modification of the slices C m , it is not restrictive to assume that all these spheres are pairwise 
non-tangent. 

Indeed, whenever the level set {W = c} is contained in the union of spheres where two or more 
are tangent, we can always consider a level set {W = c'}, with c' arbitrarily close to c, that is 
contained in the finite union of spheres with no tangent intersections among them. Hence, since 
the domains {Slp}^ GB in Remark \3.2\ are open sets and because of the uniform continuity ofW 

and f on the compact set A, we can always replace the slices C , . . . , Cm-i with slightly different 
slices such that (|39|) and (|40l) are still verified and the boundaries are contained in unions of 
pairwise non-tangent spheres. 
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4 Proof of the main result 

The plan of the proof is the following. First, in Step 1-Step 4, we combine the lemmas from 
Section |21 in order to construct a feedback control on S. Then, in Step 5-Step 7, we prove that 
such a feedback is patchy and realize the required S-constrained practical stabilization. 

Step 1. Since we are assuming that the system is S'-constrained globally asymptotically con- 
trollable, then by Proposition 12.21 there exists a strong CLF family w.r.t. S and S. Let us 
denote such a family by {<^ 7 }. 

Fixed any 5 > 0, we want to construct a patchy feedback U such that any trajectory starting 
from x G S \ T, s tends to T, s , always remaining inside S. Let 7 > be any number such 
that 47 < 5, (p = be the corresponding semiconcave function in the strong CLF family and 
f = r*j G]0,r o ] be the value given in Proposition 12.21 so that, for all x G Q(S,f) where <p is 
diffcrcntiable, one has 

V<p{x)-v{x)<--, (41) 

v being the Lipschitz continuous function from Lcmma l2.2l and C being the constant from (|27[) 
in Definition 12.31 

Step 2. Now we apply Lemma 13.11 to the semiconcave function V = (p and to the constant 
function h = C over the set = {S + eB d } \ E^T with A = S \ S 3 ^ and p = f/4 and e = C/4, 
so that we get a function W which is the pointwise minimum of a finite family of quadratic 
functions Wi, . . . 7 Wm of the form (f3U|) and a patchy feedback C7" = (£/", {P a ,Pa)aeA') on a 
domain 2?" D A such that (|31[) and (f3"2"| are satisfied, i.e. such that 

q> < W < <p + r - , (42) 

on A and 

f(x,U»(x))»W(x)<-C+ j <-£, (43) 

for all igD'. Notice that, the particular structure form (|30[) of the functions Wj implies that, 
for every direction v and every point x, there exists the directional derivative of v» W{x) and it 
actually coincides with vWk{x) = VWk(x)-v for one of the indices k such that W(x) = Wk{x). 
Moreover, by denoting with L v a Lipschitz constant for v and with L\y a Lipschitz constant for 
W on Q(S, f/2) and by choosing 

A = max{|u(x)| ; x G Q(S, r a )} + L v L w , A = — , 

for all x £ Q(S,f/2) D A = Q(S,f/2) \ ^ and all j G {1, . . . , M) such that W{x) = W 3 (x), 
by (Hi) there exists j/j G B(x,X) (~1 A such that W(p{yj) exists and \WWj{x) — V 93(2/7) I — ^- I n 
particular, this happens for the index t such that w(a;) • W(x) = VW / i ,(a;) • w(a;). Summing up, 
we obtain 



v(x) • W(x) = VW L (x) ■ v(x) < V(p(y L ) ■ v(y L ) + \v{y L )\ \VW L {x) - V(p(y L )\ + L w \v(x) - v(y L )\ 

C C 

< W(p{y,) ■ v{y L ) + A (\v(y L )\ + L W L V ) <--+£ = --. (44) 

Also, by choosing A' = p = f/4 it is not restrictive to assume diamP Q < f/4 for all a € A'. 
Finally, following Remark 13.21 we can find a > and, for K = S?/2 \ S 3 ^, a family of indices 
B C A' such that properties (i) and (ii) of the remark are verified for the piecewise constant 
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feedback {/" = (£/"", (Pp,pp)peB)- In particular, 



-K" C |J P^ C JT + - B d C S r - /4 (45) 
/3eB 

Step 3. Next, we notice that, since W is Lipschitz continuous on Q(S,f/2), (|4"4"]) implies the 
existence of e > 0, depending on 7, such that 

C 

\to-v(x)\<e ==> cj • W(a;) < - — , (46) 

8 

for all x € Q(S', f/2) \ E 3 ^, and of course it is not restrictive to assume that e < e/2, where e is 
the value from Lemma 12.31 

Hence, we apply Lemma l3~2l to f/2 and e to obtain a patchy feedback control = (U , (Q a , q a )aeA) 
defined on a domain V b D Q(S, f/2) such that (J35J, ((Ml) and (07]) are satisfied for x & Q(S, f/2). 
In particular, by combining (|35p with (|46p . we get the inequality 

/(x,C/ b (x)).M/(x)<-|, (47) 

for all x £ Q(S', f/2) \ E 3 ^. Also, it is not restrictive to assume that diamQ Q < A for a suitable 
constant A > which will be chosen at the end of Step 5. 

Step 4. Now we modify and relabel the pairs of domains and controls 

{(Q a ,q a ) ; aeA}, {(^);^8}, 

in such a way that the resulting family gives a patchy feedback on the whole S. As in Remark l3.2l 
we define the sets 

C m i{i£K d ; M* - (m + l)a < W(x) < M* - ma} m e {0, . . . , N - 1} 

where M* = max^iy, to* = vnin^W and A = l M '~ m ' J + 1, the set A still being S \ E 3 ^ as in 
Step 2. We also define 

jC n = {x e R d ; W^x) < M* - Act} . 

For j = 0, . . . , N set 

A, = {a G .4 ; Qa fl Zj # 0} , r i)0 , Q = Qa \ f |J Cl j V a G ^ ' 

and for j = 0, . . . , N — 1 set 

B j i{^eB; J 9 j <j3<j8 j+1 } 1 ^ = V /3 e 6, , 

being /?„<...< /?at the indices from Remark 13.21 Observe that, by construction, one has 

C 3 nQ(S,f/2)C |J r 3 -,o >a , j = 0,...,A, (48) 

n (Sr/2 \ ^) c |J r illii8 , j = 0, . . . , a - 1 . (49) 

/see, 
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Figure 3: The covering {r c } ce c close to dSf, for indices a < a 1 < a" S A and (3 G B. Notice 
that x(-) might start from Tjfi j0l , then cross r^o.a' and Tj i p and finally reach Tj + i t o^ a u. 

Hence, {r c } ce c is a locally finite covering of S \ £ 3 ^, with a set of indices 

C C {0, ...,N} x {0, 1} x (AUB), 

which is totally ordered through the lexicographic order (see also Figure [3]). Moreover, on each 
r c a constant control is defined by 




q v if i = , 
p v if i = 1 . 



We now claim that, in fact: 

• U = (U, (r c ,u c ) ce c) is a patchy feedback control on the domain 

V = iv b U (J P/3 \ S 3 ^ D (ff U Q(5, f/2)) \E^3S\E < ; 

• the corresponding trajectories of (JTJ) with initial datum x a G S never exit the set S] 

• U stabilizes the trajectories of ([T]) to S^. 

In the next steps we prove this claim, completing the proof. 

Step 5. To prove that U is a patchy feedback control on T> D S \ S 5 , we have to verify that 

o 

for all z €E dT c n I? in which the inward pointing condition fails, one has z G r c / for some c! G C 
with c' > c. 
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a. Consider first the case of z G dT c n V n 5 = <9r c n (5 \ S 3if ). Let us assume that c = (J, 1, /3) 
for some j = 0, . . . , N — 1 and (3 £ Bj. In this case, by definition r c = P^ and then if 

Z G \ I |J P/3< U |J Ly 

\P'>P j'>3 

the inward pointing condition in z is guaranteed by (|40p . Assume now that 2 G dPp n P/3' for 
some /?' > /8. Then, either /?</?'< or /?' G 23j' for some j' > j. In the former case 

z G rj.i,/?' an d in the latter case z G Tj/^pi and we always conclude z G r c / for some c' > c. 
Finally, assume that for some j' > j there holds 

zG^n/VA (J pA . (so) 

In this case, z cannot belong to K = Sf/ 2 \ £ 3if , because otherwise would imply 

z G C f flA'C (J P fc c (J P fc , 

/3 3 ,<fc</3 y + 1 fc>,3 

which contradicts ([5U|) . Thus, zeS \ 5 f / 2 and hence z G £j' D Q(S,f/2). Therefore, it must 
be z G £j/ fl Q Q for some a G A/< , i.e. z G r c / for some d = (j', 0, a) > a 

b. Now consider the case of z G 9r c PI (5 \ £ 3 ^) with c = (j, 0, a) for some j = 0, . . . , N and 
a e Aj. In this case, by definition r c = Q Q \ f|Ji<j A) • If z G d£j-i D Q Q , then 

/(z, u c (z)) ■ n(z) = /(z, g Q ) ■ n(z) < , (51) 

due to ljl7]l and to the unit normal n(£) to Cj-i being parallel to VW(£), at every point £ 
where W is differentiable, since dCj-\ is a level set of W . In other words, the inward-pointing 
condition is immediately satisfied in z. If z G dLj-i C\dQ a , one deduces from the fact that the 
boundary d£j-i is contained in the union of a finite number of spheres, pairwise non-tangent 
(see Remark 13.31) . that the Clarke tangent cone in z has nonempty interior. Hence, from (|51[) 
there follows that 

f(z,q a ) G T^z). 
Combining this fact with f(z,q a ) pointing inside Q a , one concludes that 

f(z,q a ) G T<?_» n Tg a (z) C T £3 _ inQa (z), 

where we have denoted, like in Section [21 with Tq the Clarke tangent cone to the set f2 and 
with Th the Bouligand tangent cone (or contingent cone) to Q and the final inclusion is a 
consequence of (|21[) . Owing to Remark 12. 1[ this means that the required inward-pointing 
condition is satisfied in z. 
Take then 

zedQ a nc r n(S\j:^) 

= dQ a n C f n ((S r - /2 u Q(S, f/2)) \ s 3 ^) j' > j , 
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If z & dQ a fl Cj> fl (Sf/2 \ S 37 ) for some j' > j, then by (J^HJ) it must be z £ Fj',i t p for some 
P € Bj' and of course (j, 0, a) -< (j', 1, /3), i.e. z 6 T c / for some c' > c. On the other hand, if 

ze (dQ a nQ(S,f/2))\ [J Q Q ' c 9<5q, \ |J Q Q /, 

a'>a a'>a 

then the inward-pointing condition is verified because u c = u a = , which was patchy on 
Q(S,f/2). Recalling (|38"]). the remaining case is 



z G <9Q Q n n j (J Q Q , J 

\a'>a / 



which implies z € Tj/fi,a' with (j, 0, a) -< (j',0,a'), and therefore z <E r c / for some d > c. 

o 

c. It remains to consider the case z £ (dT c n V) \ S. Recalling (|45|) and the definition of V, 

o 

we have z £ (dT c n P b ) \ 5 and therefore it must be c = (j, 0, a) for some j = 0, . . . ,N and 
ci £ jAj . We also observe that by denoting with Lf and Lw Lipschitz constants for / and W, 
respectively, on Q(S,f/2) + sBd, by setting 

M Q,f = max \f( x > u )\: 

(Q(S,r/2)+cB d )xU 



< A < min 



C C 



32 Lw Lf 32 Lw Mqj 
and by requiring diamQ Q < A in Step 3, from (j47]) there follows 

/(z, u c (z)) . W(z) = f(z, q a ) . W(z) < - ^ < . 

Hence, by repeating the same argument used for the case z £ dT c n (S \ S 37 ) with c = (j, 0, a), 
we obtain the required property also in this case. 

Since we have proved that in every case, either the inward pointing condition is satisfied or 
z £ T c i for some d > c, this completes the proof that U is patchy on T>. 

Step 6. We prove now that any trajectory x(-) of |T]), corresponding to the control U and such 
that a;(0) £ S \ S" 5 , remains inside S for all times t > in its maximal domain of existence 

First, observe that it is enough to prove the property for trajectories x(-) with a?(0) in the 
interior of S. Indeed, if x(0) £ dS, then there exists a small t > such that in ]0,r] a solution 
exists, because the vector field is patchy, and belongs to the interior of S, because of 
Hence, by applying the result on the interior of S to the solution of ([T]) with initial datum x(t), 
one concludes that the property holds also for trajectories starting from the boundary dS. 

o 

Now, take x(0) £ S and assume by contradiction there exists t s]0, T max [ such that x(t) £ dS 
but x(s) belongs to the interior of S for < s < i . Then, 

x(t) £ T e , where c = c*(x(t)) = max{c 6 C ; x(t) £ T c } , 

and u s = U(j.o,a) = la for some index a £ Aj, because (jl5)l implies that UseB^Ji 1 !/ 8 — ^f/A- 
Thus, f(-,Uc(-)) satisfies ([55)) - ([3T]) . Moreover, being T s an open set and U a patchy control, 
there exists r £ [0, t[ such that for s £ ]r, t\ one has 

x(s) £ T £ , x(s) = f(x(s), u £ (x(s))) = f(x(s), q a ) . 
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Now assume that As is differentiable in x(s) for a.e. s g]t, i]. Then, by combining the local 
decrease property ([55]) . applied in a neighborhood of x(t) G OS, with the boundedness of VA5 
and the continuity of / in r g , there exists r' G [r, t[ such that for a.e. s G there holds 

VA s (i(s)) -f{x(s),q a ) < VA s (x(s))-f(x(t),q a ) 

+ |vA s (z(s))| \f(x(t),q a )~f(x(s),q a )\ < -e/2 < . 

In turn, this implies 



d(:r(t"),M d \ 5) - d(x(r') 7 R d \ S) = -A s (x(t)) + A s (x(t')) 

= - J VA s (x{a))-x(a)da> ^(i-r')>0, (52) 



which yields 



d(x(y), R d \S)< d(x(t),R d \ S) = . 



This gives a contradiction because x(r') belongs to 5 and, therefore, its distance from K d \ 5 
should be positive. 

Observe that we may reach the same conclusion even if A5 is not differentiable along the 
trajectory x(-) on a set I C ]r, t\ of positive measure. Indeed, denote with r' G ]r, t] a value such 
that x(s) G A/^(f) for s G [t',F| and ^(t) the neighborhood of x(t) in which ([38]) holds. Then, 
one can always find an arbitrarily close curve x a { ) = x(-) + a, a G M d with |a| <C 1, where 
Ag is differentiable a.e., since otherwise Ag would turn to be not differentiable on a subset of 
positive measure of a neighborhood of x{-)\[ T i_t\ 

{x(s)+pB d ; s G [r',t\, p<l}. 

Hence, we can repeat the above computation for the variation of A5 along such a curve x a (-): 
by x a = x and by the arbitrary closeness of x a to x(-), we thus reach a contradiction also in 
this case. 

Step 7. To complete the proof, it remains to show that U stabilizes trajectories of (TTJ) to S" 5 . 
By and ([37]). we know that for all x G V D 5 where VVF(a;) is defined, there holds 

/(x,[/0z)).W0z)<-^. (53) 

Hence, fix any intial datum x G S 1 \ S* 5 and denote by x(-) any corresponding Caratheodory 
solution to ([3]), defined on its maximal domain [Q,T max \. Notice that, by invariancc of the 
set S and by the inclusion A = S \ S 3 ^ C T>, it can only happen that either x(T~ lax ) = 
hm^y- x(t) G dT> n S 3 ^ or that T ma2; = +00 and the trajectory remains inside A for all 
times. We claim that the latter case cannot happen. 

Indeed, assume T max = +00 and that x(t) G A for all t > 0. Introducing to^ == minA (p, we have 
that rrij > 0, because of the Definition 12.31 of strong CLF family, and that minA W > > 
because of (|4*2"j). Since we have by (|55|) 

f* Ct 
W(x(t))-W(x )= f(x(s),U(x(s))).W(x(s))ds<- — , (54) 
Jo 8 

for t large enough we obtain 

Ct 

W(x{t)) < W{x ) - — < , 
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which is a contradiction. We can thus conclude that 

and therefore, by continuity, it is well dchncd 

T = inf {s e [0, T max [ ■ x(a) £ V n S 5 Va e [a, T TOO:c [ } , 
so that for f € [T,T moa; [ one has x(t) £ S 5 . 

This completes the construction of a feedback control which stabilizes the system to E 5 . o 

5 Proof of Lemma 13.21 

Due to their extensive use in the following proof, we recall that the notations S r and Q(S, r), for 
r > 0, were introduced in (j2"3"]) - ([IM)) and that for any a; £ 5 we use r(x) to denote the quantity 
d(x,W\S). 

Step 1. First of all, let r a > be as in Lemma [2.11 v: Q(S,r a ) —> R. d be as in Lemma [2.21 
and e > be as in Lemma [2.31 Fix e £]0,e/2[ and r £}0,r o [. By uniform continuity of the 
function v on Q(S,r a ) and of the function / on Q(S,r a ) x U, there exists S > such that for 
all x, y £ Q(S, r Q ) and u £ \J one has 

\v(x) - v(y)\ < § , 

\x-y\<6 =► (55) 

\f(x,u)- f{y,u)\ < §. 

Notice that, in view of p4p . it is not restrictive to assume S < r a — r and that, in view of 
the required bound on the diameter of the domains, we can assume also 5 < A/ 2 for any fixed 
constant A > 0. Finally, we remark that, for any radius R > 0, one always has 

\v-v'\<- =^ W(v',R/2)CW(v,R). (56) 

Step 2. In order to define the patchy feedback, we start with the construction of suitable 
neighborhoods T x around each point x £ Q(S,r). Recalling that by Lemma [2.21 we have v 
Lipschitz continuous and u ^ on Q(S, r a ), we set 

M v = max \v(x)\ < +oo , m v = min \v(x)\ > 0, 

Q(S,r )' Q(S,r )< 

and fix p such that 

< B < min <^ 1 , — — I . 

Consider now the wedge W(v(x),e/2) and recall that for points z £ d~W(v(x),e/2) there 
holds (|2"2"|) . Then, a similar estimate holds for points 

z£d- (/3W(v(x), e/2)) = Bd-W(v(x), e/2) . 

Namely, every point in z £ d~ \ ByV(v(x), i/2)j has an uniformly positive distance from M. d \ 

W(v(x), e), that we denote with p x . Since the axis of W(v(x), e/2) always satisfies \v(x)\ > 
77i v > for x £ Q(S,r ), there also is p > such that 

Po < Px yx£Q(S,r a ), 
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Figure 4: Left: The rescaled wedge x + (3W{v{x) 1 e/2) is well inside the wedge x + W(v(x), e). 
Right: The domain T x is obtained by a small translation of x + (3W(v(x), e/2). 



and hence (see Figure 0] left ) 

< po < d(z,R d \W(v{x),e)) Mz G d~ (8W(v(x), e/2)) VieQ(S,r ) 

We finally fix a such that 



< a < min 

and define, for every x G Q(S,f) 



5_ Po_ P_ 

3 ' 2 ' 2 



r* = .t - a -^4r + 0W(v(x), e/2) . 
\v(x)\ 

o 

In other words, we first rescale the (open) wedge x + W(v(x),e/2) by a suitable factor /3 and 
then we slightly shift it along the direction —v(x), in order to obtain an open neighborhood of 
x. The particular choice of a, /3 ensures that for every x G Q(S, f) there holds 

T x QB(x,5). (57) 

Indeed, given £ G T x there exist s,a € [0, e/2[ and z G £?d such that 

u(x) 

£ = x — a + (3s (v(x) + az) , 

\v{x)\ 



and, hence, 



\x-£\ < a + f3s(\v(x)\ + a) <a + ^(2M. v e + e 2 ) <S. 



Moreover, if we split the boundary dT x into its "lower" and "upper" parts, by setting 

d~T x =x-a -^4r + d ~ (0W(v(x),e/2)) , d+T x = 0T X \ d'T x , 

\v(x)\ V J 
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the choice of the parameters a and (3 also ensures that the lower boundary d T x is well inside 
the wedge x + W(v(x), e) for every x G Q(S, f). Indeed, for z G d~T x we have 

d (z , R d \ (x + W(v(x),e))} > d (z + a ^j- , R rf \ (x + W(v(x),e)) J - a 

>Po- ^>0. 

In particular, fixing a point x G Q(S, f), the wedge x + W(w(x),e) is contained in S r r x \ by 
Lemma |2~51 and hence for every z € d~T x there holds 

d (z , M d \ 5 r(E) ) >d(z, R d \(x + W(v(x),e))) > ^ > a , 

which ensures that 

r(z) > r(x) + a Vz G d~Y x . (58) 

Step 3. Recalling ([25]l. for any choice of a point a; £ Q(S,r) there exists % C U such that 
t;(x) = f(x,u x ). Now, we claim that by choosing U(-) = u x in T x properties (jHSJ), (jUJ) and ([57)) 
are satisfied on each domain T 1 . For all )j e T 1 f)Q(S, f), inclusion (1571) implies \<q — x\ < 8, and 
hence by ([S3)) there holds 

|/(r?,u x ) - v(?/)| < \ f{-q,u x ) - f(x,u x )\ + \v(x) - < £ < e/2. 

This already gives ([55")) . Moreover, recalling ([55)) . we deduce that for all 77 G T x n Q(S,r) there 
holds 

W(/fa, C ^(/(jy.Ux),^) C W( V (r,),e), 

W(-/(^,« x ) > e) CW(-/(f/,Ux),e/2) CWC-w^.e), 
In turn, with Lemma |2.3[ this implies for all y G {?/ + ei?^} PI Sy^) 

7/ + W(/(r7,u :c ),e) Cy + W(w(»?),e) C 5 rW , 

O 

and for all y G {?] + \ SV^) 

y + w( -/(»/, ««),£) c tf + w(-«(77),e) a d \s rW , 

i.e. (HH) and ([57)1 . 

Finally, we claim that the vector f(r), u x ) is always inward-pointing at points 77 G i9 + r :r nQ(S', f). 
Indeed, once again ([55)) and ([STf give \ f(rj 7 u x ) — v(x)\ < e/2 < e/4 and with ([56)) this implies 
i] + cf(r/,u x ) G 77 + W(i>(x), e/2) for some < c < 1, proving the inward pointing condition at 
77. 

Step 4. We now replace our sets T 31 with the slightly smaller ones defined by 

f2 = r \ S' r (a;) + Q , 

where a is the parameter chosen in the construction of the domains T x . Of course, Cl x is still 
an open neighborhood of the point x, like T x was. Moreover, recalling ([55)) . we observe that by 
removing S r t x \ +a we have cut away a part of T x which contained the whole "lower" boundary 
d~T x . Hence, we can divide the boundary of il in 

d+n x = d+r x \ s r{x)+a , d~n* = dn x \ d+n x = r x n ds r(x)+a , 
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and now we have r(z) = r(x) + a for all z £ d OF. Moreover, at points 77 <S d + il x D Q(S, f) C 
g+Y x n Q(S,f) the vector f(n,u x ) is still inward-pointing. 

Now, by compactness of Q(S,r), there exists a finite set of points x\, . . . ,xn £ Q(S,f) such 
that 

N 

Q(S,r) c\Jn**. 

i=l 

We re-label the sets as follows 

and we order the collection {Q r ( x .) ti } with lexicographic order (fT5)) , i.e. 

(r(xi),i) -< (r(xj),j) iff cither r(xi) < r(xj) or r(xi) = r(xj) and i < j . 

The advantage of this choice is that we can easily prove that points of d~Vl Xi , i.e. of the "lower" 
boundary of f2 x< , belong either to Sf or to another domain D, r / X .^j with larger index. Namely, 
fix i £ {1, . . . , N} and let z £ d~VL Xi . Then, if r(z) < r there must be an index j £ {1, . . . , N} 
such that z £ fl Xj . Assuming now that 

(r(xi),i) ^ (r{xj),j) 

we would have, in particular, that r{xi) > r(xj) and therefore 

\ S) = r(xi) + a > r(xj) + a => z£S r [ Xj)+a , 

which means z ^ fl Xj = T Xj \ S r ( x .)+ a , i.e. a contradiction. 

Step 5. We claim that by setting V = Uj=i ^r(x } ),j an< i U: V — > U the piecewise constant 
feedback law defined by 

U(^) = u Xi for all £ £ il r (xi),i \ U ^r(x 3 ),j 

(r(xt),i)-<(r(xj),j) 

we obtain a patchy feedback control U which has the required properties. Indeed, the choice of 

5 in Step 1 ensures that 

diamfl r ( a ..) i j < di&m B(xj, 8) < A , V C Q(S, f) + (r a — r)Bd . 

Moreover, in Step 3 we have proved that (f3"5)) . (|3"6) and ([3T|) hold for all y £ Q(S,r). Finally, 
Step 4 proves both that is inward pointing at points of d + Q r r x .\j and that points 

of d~fl r ( Xj yj do not need to be taken into account because they belong either to a patch with 
larger index (r' , j') or to dV n Sf (see Remark l2.3p . Hence, U is a patchy feedback control and 
the proof is complete, o 

6 Extensions and remarks 
6.1 S— restricted dynamics 

Our main result has been stated and proved for a control system (TTJ) whose vector field / is 
defined in the whole M. d x U. In many applications to economy and engineering, though, the 
dynamics could have no meaning or even break down completely when x ^ S. As such we want 
to stress that Theorem [1] can be also applied to the case of a control system (TTJ whose dynamics 
is given by a function / : S x U — > M. d not defined for x ^ S. 
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Indeed, in the same spirit of [TTJ [T2] , we can extend / to a globally Lipschitz continuous 
function /: R d x U R d by denning / = (ft, . . . , f d ) as follows 

/i(ar,u) = rnin{/i(y,u) + L / |x-y|} . (59) 

y to 

Now, assuming that the vector field / satisfies (Fl), (F2) and (F3) on its domain S, then also 
/ satisfies (Fl) and (F2) on the whole M. d . However, / might fail to satisfy (F3) outside S. 
Luckily, this is not a problem for our result: we needed convexity of f(x, U) to ensure that the 
function v(x) in Lemma 12.21 equals f(x,u x ) for a suitable admissible control value u x G U. As 
such, (F3) is only necessary inside S, and the rest of our construction can be applied to the 
dynamics 

x = f(x, u) , (60) 

with no significant change. 

6.2 Unbounded constraints 

Another assumption that can be relaxed in our main result is the compactness of the constraint 
set S. Indeed, as it has been done for sample-and-hold trajectories in [12] . one can require S 
to only be a closed set. In the latter case, it is possible to prove the following 

Theorem 2 Let S be a set satisfying (SI) and (S2), except for compatcness in (SI) replaced 
by closedness, and let £ be any closed set such that SC\H ^ 0. Assume that for all bounded sets 
of initial data B, the trajectories of the system fl} starting from B are open loop controllable to 
£ remaining inside S . Then, for every fixed bounded set B there exists a patchy feedback control 
U = Ub(x) which makes (TTJ) practically stable to £ subject to the constraint S. 

To prove the theorem above, notice that the results about wedged sets and strong CLF 
families given in Section [2] still hold under the relaxed assumptions of Theorem [2] (sec [T2l I13j ). 
Therefore, for the fixed bounded set B, one can simply take a large enough ball K = kBd such 
that B C K and (S fl K)C\Y, ^ 0, and apply Theorem[T]to the smaller constraint set S' = S (1 K . 
In this way, for every 8 > we obtain a patchy feedback control such that trajectories starting 
from B remain inside S for all positive times and eventually reach (SnK)PiT, s C E" 5 , as required. 

6.3 Robustness 

One of the main advantages of using patchy controls U (x) and Carathcodory solutions for ([1]) 
over allowing arbitrarily discontinuous controls and weaker concepts of solutions like samplc- 
and-hold trajectories (see [TTJ [T2J [T3]), is that stronger robustness properties can be proved 
with almost no efforts. 

It is indeed well known that whenever the vector field 

g(x) = f(x,U(x)) , 

is a patchy vector field in the sense of Definition 12.11 then the set of Caratheodory solution is 
robust w.r.t. both internal and external perturbations (see [U[2j[4]) without any additional as- 
sumption on the feedback control U. This represents a noticeable improvement compared to the 
construction obtained in |11[ 1121 1 1 3j through sample-and-hold and Euler solution, which only 
achieves the same robustness by requiring a "reasonable uniformity" in the time discretization. 

This additional robustness holds also in the case of a constrained dynamics. Namely, the 
following theorem holds. 
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Theorem 3 Assume that the system ([T]) satisfies open loop S -constrained controllability to E, 
where S is a set satisfying (SI) and (S2) and E is any closed set such that S (~\ E ^ 0. Then, 
for every 8 > £/iere eas'si T > 0, x > arlc ^ a patchy feedback control U = U(x), defined 
on an open domain T> with S \ E 5 C T>, so that the following holds. Given any pair of maps 
C G BV([0,T],R d ) and d G L x ([0, T], R d ) such that 

IICIIbv = HCIIli + Tot.Var.(C) < X , \\d\\v < X , 

and any initial datum x G S \ E" 5 , for every Caratheodory solution t >— > y{t), defined for 
t G [0,T], of the perturbed Cauchy problem 

y = f(y,U(y + Q) + d, y(0) = x o , (61) 

one has 

y(t)eS Vte[0,T], and y(T) G E" 5 . 

We do not include the explicit proof of this theorem, since it follows very closely the one 
of Theorem 3.4 in [2], by combining Theorem Q] with the general robustness results for patchy 
vector fields in presence of impulsive perturbations, proved by Ancona and Brcssan in [2]. 

6.4 A new construction for unconstrained stabilizing patchy feedbacks 

Among possible applications of Lemma 13 - 1 1 we mention here the construction of a practically 
stabilizing feedback for control systems ((T|) which are GAC to the origin and with no constraints 
on the dynamics. This result was first proved in [1], by means of a different construction, relying 
on open-loop controls rather than on Lyapunov functions. 

We recall that an unconstrained control system ([T]) is said to be globally asymptotically 
controllable (GAC) to if for every initial datum there exists an open-loop control, with values 
in U, which steers the corresponding solutions to the origin, and if solutions starting sufficiently 
close to remain close to for all times (see e.g. [TJ Q2J [T7]). By the results in fT5j, we know 
that if (HJ) is GAC to the origin, then there exists a control Lyapunov function V: M. d — > [0, +oo[ 
which is locally semiconcave on M. d \ {0} and such that 

min{W(:E) ■ f(x,u)} < -V(x) 

for all x £ R d \ {0} where W exists. Now, fixed any compact set of initial data K C M. d and a 
target ball e'Bd around the origin, we prove that there exists a patchy feedback which stabilizes 
to e'Bd every trajectory starting from x £ K. 

First of all, we apply Lemma 1331 to f2 = R d \ {0}, 

A = £ R d ; V(0 < maxF+ l} \ {0} , 

h{x) = V(x) and p = e = 5/2 for a suitable 8 G ]0, 1] such that 

£ = {£ G R d ; V(0 <8}c e'B d . 

Notice that such a value 8 exists because V is proper. Hence, we obtain a piecewise quadratic 
function W : M. d — >• R and a patchy feedback control U: T> — > U, defined on an open domain 

V D U e K d ; 8 < V(£) < maxV+ l| D A\ e'B d , 
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such that 

V(x) < W(x) < V(x) + - , 

for all x G A, and 

f(x,U(x)).W(x) < -V(x)+ 5 -, 

for all x e V \ £. 

We claim that W decreases along the solutions corresponding to U, until the trajectories sta- 
bilizes inside e'Bd- Indeed, fixed an initial datum x G K \ e'Bd, we denote with x(-) any 
corresponding Caratheodory solution starting from x . In any interval [t , ti], there holds 

W{x{h)) = W{x{t )) + j 1 f(x(a),U(x(a))) • W(x(a)) da (62) 

< W(x(t ))+ J (-V(x((t))+ - J da< W(x(t ))- -(h-t ) < W(x(t )) 

where we have used the fact that x(a) £ £ and hence V(x(a)) > S for a E [t ,ti]. 
Hence, from (|62|) and W(x ) < V(x ) + 1, we can deduce that the trajectory x(-) starting at 
x Q G A C T> remains in the bounded set A for all times in its maximal domain [0, T max \ and, in 
particular, that \x(s)\ -/+ +oo and x{s) -fr dT> \ £ C dT> \ A, as s — > T max . Therefore, either the 
trajectory x(-) remains in A \ £ for all times and T max = +oo, or x(T~ ax ) = \im t ^ T - x(t) G 
dT> n £ . In the former case, we would get a contradiction because for s large enough 

V(x( S )) < W(x( S )) < W(x(t )) -i( 8 -t„)<i, 
which implies x(s) G £ . We thus have that 

x(T- ax )edvn£ce'B d , 

and therefore, by continuity, it is well defined 

T = inf {s G [0,T max [ ; x{a) ePfl e'B d Va G [s,T max [ } , 

so that for t G [T, T max [ one has x(t) G e'B^, i.e. U stabilizes Caratheodory trajectories to e'Bd 
as claimed. 

We conclude by remarking that, as in pQ, once a practically stabilizing patchy (to the origin) 
has been constructed, one can also construct a stabilizing patchy (to the origin), by suitably 
gluing together the controls U n which realize practical stabilization to — B d - 

6.5 Conclusions and open problems 

In this paper we have positively solved the problem of practical stabilization of a constrained 
dynamics through feedback controls. As expected, the control is in general discontinuous but it is 
possible to select the discontinuity in a suitable way so to obtain a patchy feedback control, which 
in turn ensures the existence of Caratheodory solutions of the closed loop system for positive 
times, and the robustness of the feedback with respect to both inner and outer disturbances. 

The problem that remains open and that is currently under investigation is the existence of 
nearly optimal patchy feedbacks for a constrained dynamics. In the unconstrained case, it is 
known that nearly optimal patchy controls exists (see [31 [7]), but in the constrained case the only 
available result is the one contained in involving general discontinuous controls and and 
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Euler solutions. In view of the further robustness properties enjoyed by patchy controls, it would 
be of interest to provide a similar construction in terms of patchy feedbacks and Caratheodory 
trajectories. 

Acknowledgment. The author warmly thanks Prof. Fabio Ancona for his careful reading of 
the manuscript, his precise comments and for the repeated discussions on the various aspects 
of the construction. In particular, the final formulation of Lemma 13.11 in its full generality is 
extremely indebted to his suggestions. 



Appendix: Proof of Lemma 13.1 



The proof is divided in several steps. First, in Step 1-Step 3 we define an approximate function 
W with the required properties, then in Step 4-Step 8 we define the patchy feedback control U, 
and finally in Step 9 we observe that such a construction allows to find a constant a > and a 
subset of indices B C A with the properties stated in Remark [ 



Step 1. Let V be a given locally scmiconcave function and h be a given continuous function 
such that (f2"9"| holds. Fix A bounded set in the domain of V, p > and e such that < e < 
maxj/i(2;). Fix also two positive constants A, A' which are required for properties (Hi) and (iv). 
By semiconcavity of V, there exists k > such that, for any y, y' G A, one has 

V(y')<V(y)+w(y' -y) + K ] y^l, (63) 

for some vector w € D + V(y) in the superdiffcrential of V at the point y, i.e. for some vector 
w such that 

lun sup : . 

IC - y\ 

Moreover, V is Lipschitz continuous on its domain Q and we denote with Ly a Lipschitz constant 
for V , namely 

V(x)~V(y)<L v \x~y\ Vx,y£ft. (64) 

Hence, by Rademacher's theorem, V is differentiable almost everywhere in 0. 

Finally, notice that given any 5 > 0, we can choose finitely many points yi, . . . , y q S A such 
that W(jji) is well defined for each i = 1, . . . , q, and moreover 



AC \jB( yi ,S ). (65) 



Therefore, we can define an approximate value function, depending on the choice of <5 Q , 

W{x) = min{Wi(a;) ) ...,Wg(a;)}, 

where 

Wi{x) = V(y t ) + W(yt) ■ (x - y t ) + k\x - y 4 | 2 . (66) 

A couple of remarks are in order. First of all, each function W\ is quadratic, and hence differ- 
entiable. Moreover, there holds 

VW i {x)=VV(y i )+2 K (x-y i ), (67) 

and VWi( yi ) - Wfofc). 
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Step 2. We claim that, by choosing S a = S a (p,e) > sufficiently small in the definition of W, 
we can obtain the following. For all x £ A there hold: 

V(x) < W(x) < V(x) + p (68) 

min{VWi(x) ■ f(x,u)} + h(x) < e/4 whenever Wi(x) = W(x) . (69) 

Indeed, the first inequality in follows from (|53")) . Next, since / and h are continuous and 
U is compact in U, we can find Si €]0, 1] such that the following conditions hold. If x £ A, 
w = VV(y) exists and 

|w'-w|<2k£i, |x-y|<<5i, 



then ra, i.e 



min{w • f(y,u)} + h(y) < 0, 



implies 



min{w' + < e/4. (70) 



We now choose S„ > such that 



2Lyi5 + k$1 < min <j p, — i 



and select the points y\ , . . . , y q to cover A as in (I65p . 

To prove that such a choice of S gives a function W with the required properties, fix any x 6 A 
and let j be an index such that \x — yj\ < 5 a . Recalling the Lipschitz condition (|64j) we find 

W(x) < V( yj ) + |W(ift)| |a; - %| + k|z - yj | 2 < ^(a:) + 2L v \x - Vj \ + k\x - y 3 \ 2 , 

W(x)-V(x)<mmU^\. (71) 

This already yields (pjBl . Comparing with we notice that for all x £ A and all 

j £ {1, . . . , q} there holds 

Hence, from (|7T|) . there follows 

I a; - yj\ <6i, whenever Wj(x) = W(x) . (72) 
Observing that, if \x — yj\ < S±, 

\VWj(x) - VWj{yj)\ =2n\x ~y,j\< 2k5i , 

from ([7D1 and (|72"|) we deduce the inequality This establishes our claim. 

Step 3. By observing that for any choice of A > in Step 1, we can always assume 5\ < 
min{A, ^} in Step 2, we immediately obtain that if W(x) = Wj(x), then the point yj used to 
construct Wj has the property (|33|1 . Indeed, exactly like in Step 2, one has \x — yj \ < X and 

\VWj(x) - yV(yj)\ = \VWj{x) - VWjiyj)] < 2k8i < A. 

This ensures that W satisfies (in). 
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Step 4. Now we move to the construction of the feedback control U. We set 

£ = {x G A ; h(x) < e} . 



(73) 



First of all, we need an estimate on the size of level sets of the functions Wi over A\£. Since (|66[) 
implies 

Wi(x) = k|x - x,| 2 + V(y t ) - |W ^ i)|2 , 

4K 

with Xi = yi — W(j/i)/2«, it is clear that all level sets where Wi is constant are spheres. Indeed, 
for any given constant c > 0, we can write 

{x G M. d ; Wi(x) = c) = {x G R d ; \x - x*| = n} , 

for a suitable radius n > 0. We want to prove that r, is in fact bounded above and below, for 

levels which intersect A\£. 

For each i = 1, . . . , q, consider the set 

Ai = {xeA\£; Wi(x) = W(x)} . 

We show that there exists a maximum radius r max and a minimum radius r m i n > such that, 
fixed x G Ai, the level set {£ G K d ; Wj(£) = Wj(x)} is a sphere of center x% and radius r» with 



^ ^min ^ ^ ^*7i 



(74) 



Indeed, by (|66[) and (f?2")) . we have for every x G A 

|VW»(ar)| < \VWi(yi)\ + 2k|x - y t \ < L v + 2n5i < L v + 2k . 
At the same time, when x G A \ £, from ([M]) and ([73")) there follows 



max|V^(x)| |/(x,u)| > h(x) ~ J > ~T 

uGU 4 4 



Hence, calling 



we deduce 



M 



f= max /(x, it)| < C/(l + diam A) 



|W,(x)| > 



4e 



4M 



C. 



f 



(75) 



Therefore, recalling the choice of Xi and (p7|) . fixed i 6 A, C A \ £ and chosen £ with Wj(£) 
Wj(x), one has 



|VW t (x) 
2k 



£ 1 

2k' 



2k 



f mm , ' max y 



Step 5. We will now define a patchy control on a domain containing A\£. Given 77 > small, 
for each x G A,; consider the point (see Figure [SJ 



. 2 1 x - Xi 

Pi = T y x + v x i+11- 



|x - Xi\ 
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and the ball Bf = B (pf, \x — Xi\/3) centered at pf with radius r = \x — Xi\/3. By (|6"9")l . there 
exists a stabilizing control value u — uf G U such that 

VWi(x)-f(x,uf)<-h(x)+s/i. (76) 

Consider the lens-shaped region 

Tf = Bf\B(xi,\x-Xi\-ri) . 

Its upper boundary will be denoted as 

&*Tf = arf\B(xi,\x-Xi\-v) ■ 

Also, for z £ d + Tf , we write Ui(z) for the outer unit normal at the point z. Our first goal is to 
show that, by choosing 77 > sufficiently small, the following holds: 

VWi(z)-f(z,ut)<-h(z)+e/2, VzgIT, (77) 

n,(z)-/(z,<)<-^, Vzed+rf, (78) 

diamrf<A', (79) 

where A' > is the constant fixed in Step 1 for property (iv). Moreover, the constant r\ > can 
be chosen uniformly valid for alii = 1, . . . , q and all x£A,. 

For fixed i, x this is clear because, as 77 0, the diameter of the set Tf approaches zero and 
therefore J79[) is immediate. Moreover, as z varies on the upper boundary d + Tf , all the unit 
normals n;(z) approach the vector 

x — Xi VWi{x) 
\x-n\ = \VWi{x)\ ' 

Therefore, both inequalities (JT7J)— (JTHJ) follow from (fTBf and continuity of /, h 7 VWj. 

We now observe that / = f(x,u) is uniformly continuous on the compact domain A x U and 
h{x) is uniformly continuous on the compact domain A. Moreover, on each set Aj, the gradient 
\7Wi(x) is uniformly Lipschitz continuous and bounded away from zero. Also, the radius of each 
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level set, where Wi is constant, by ([74"]) is uniformly bounded above and below. This allows us 
to choose a constant 77 > uniformly valid for all i, x. 

Step 6. Estimates (|77[) - (f78")) are exactly what we need on the region where W — Wi. However, 
they do not provide any insight about the behavior of /(•, uf ) on the set 

rf n {z e R d ; W(z) = W 3 (z) < Wi(z), 3 + i] , (80) 

when this set is nonempty. In order to take care of this situation, we observe that the set where 
Wi = Wj is always a hyperplane, say 

Hij = {x G R d ; Wi(x) = Wj{x)} = {x G R d ; ■ a; = cy} . (81) 

for a suitable constant cy and a unit normal vector . The orientation of n.y will be chosen 
so that 

{x G R d ; Wi(as) < Wj(x)} = {x G R d ; • a; < cy} . 

We now claim that, by choosing 77 > sufficiently small, uniformly w.r.t. only one of the 
following two cases occurs. 

CASE 1: At every point z G Tf n %j one has 

n ii -/(«,«f)<-7 7 . (82) 

CASE 2: At every point z G Tf such that W(z) = Wj(z) one has 

VWj(z)'f(z,vZ)<-h(z)+e. (83) 

Indeed, assume that ([521 fails. Then, there exists a point z* G Tf n %j such that 

»y •/(**,<) > 

By (|8ip and the orientation of the unit vector n, 3 , we can write 

VW j (z*) = VW i (z*)-0n ij 

for some constant (3 > 0, uniformly bounded above thanks to the bounds proved in Step 4. This 
now implies, relying on ([77]). 

VWi-CO ■ /(z*,<) = VWi(0 ■ /(/,<)^n y ./(/,<) 

< -/i(z*) + e/2 + /3 rj < -h{z*) + 3e/4 , (84) 

provided that we choose 77 > sufficiently small. Since / and h are uniformly continuous and 
VWj is uniformly Lipschitz continuous, from ((84)) it follows that (|83[) is valid for all z sufficiently 
close to z* . By reducing the size of rj > 0, by Step 5 we can make the diameter of the lens- 
shaped domain Tf as small as we like and therefore, up to a last reduction of rj, wc finally get 
the inequality (|830 for all z G Tf. 

Step 7. In order to define the patchy control, we now replace some of the domains Ff with 
smaller ones: we define the domain 

fi? = r?\ |J {zeR d ; W J (z)<W l (z)} , (85) 
jeii 
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where Ii C {l,...,q} is the set of indices j ^ i for which CASE 1 applies. We recall that, if 
CASE 2 applies for the index j ^ i, this means that in points z e Tf n {£ ; Wi(£) > Wj(£)} 
one has both inequalities 

VWi{z) ■ f(z, <) < -/»(*) + £ , VWj (z) ■ f(z, uf) < + e . 

In particular, the latter one ensures that the inequality (j52"]l is satisfied in rf with U(x) = uf 
also in those points where W — Wj < W{. On the other hand, if CASE 2 docs not apply 
and ((32)) could fail, we must be in CASE 1 and, therefore, the vector field f(z,uf) is pointing 
towards the interior of 

r?nU; u, so- u-;o! 

in all points z 6 Hij = {£ ; = Wj (£_)}. Hence, we would like to remove from the 

domain Tf the region where can fail. We just have to verify that f{-,uf) satisfies the 
inward-pointing conditions in all new points of the boundary, i.e. in points of 30f D Hij- For 
points z 6 Of n \ drf , inward-pointing condition is an immediate consequence of (|52"|) ; for 
points z 6 fif n fl <9 + Tf the condition is satisfied because, for t > small enough, one has 
z + tf(z,uf) £ fif and hence the vector is inside the Bouligand cone as requested by (fTTj) . 
We also remark that, since fif C , from ((75|) we get diamfif < A' for all z, cc. 

The family of all domains Clf, as i e {1, . . . , q} and x ranges over the closure of the set A \ £ , 
represents our candidate for the covering in the definition of patchy feedback. Hence, we now 
select finitely many domains Qf which cover the compact set A\£. This step, however, must 
be done with some care because on the lower portion of the boundary 

0-fif = dvq C\B { Xi ,\x - Xi\ -r)) . 

the vector field /(•, uf) may not be inward-pointing. To cope with this problem, we first observe 
that there exists a uniform constant a > such that 

Wi(z)<Wi(x)-a, (86) 

for every i, x and every z £ <9~Of . 

We now set M* = max-^W, m* = min^^W^ and N = [ M *~ m * J + 1, and split the domain 
A \ £ in sub-domains of the form 

U = {x e A \ £ ; M* — (£+ l)u < W(x) < M* - £a} . 

For each I g {0, . . . , N — 1}, we cover the compact set Cg with finitely many domains Of, with 
x G C(. After a relabelling of both the domains and the corresponding vector fields from ([TBI , 
this yields the collection (see Figure [6]) 

(fi,, Q) f(;U e , a )) , a = l,...,N e , (87) 

where U^ a = whenever = Of, and the values uf had been chosen in Step 5. 

On this collection (|87p . wc define the lexicographic order "-<" from (]19p and we claim that 
the above construction yields a patchy vector field on V = U ^A\£: 

f(x)=f(x,U e , a ) iff a?6fi<,a\ IJ fi *'>«'- ( 88 ) 

(£,a)-<(<',a') 

Indeed, according to Rcmark l2.3l it suffices to check that, for each patch f^ iQ = Of, the vector 
field /(•, Ui_ a ) = /(-,wf) is inward-pointing at every point of the set 

(sn Aa n x>) \ |J o^, a , . 

(£,Q)^(f',a') 
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Figure 6: The patches Q.i >a used to cover A \ £ = (J £g. 



In the present case, this is clear, because we have already remarked that the vector field is 
inward-pointing on 

dn*n(d + r*un l3 ) . 

As such, the only boundary points where f(-,u?) can fail to be inward-pointing are those on 
the lower boundary <9~Slf . From x £ Ci, we deduce W(x) < M* — £cr, and hence by (f5rJ|) 

W(z) < M* -(£ + l)cr Vz £ . 

Therefore, given any point z £ <9~f2f PlD, 2 £ £p for some > £. Thus, either z £ dT> and there 
is nothing to verify, or z is contained in a patch fV,a' with £' > ^, as required in Remark 12.31 

Step 8. We want to show that, with the definition of the patchy feedback U given in Step 7, 
there holds 

WW(z)-f(z,U(z))<-h(z) + e, (89) 

for all z £ T> \ £ in which VW(z) is defined. But this is now immediate since, if (£,ct) is the 
patch index such that z £ fli^ a but 2: ^ fif^' for (£,ct) -< (£',a'), then there exist indices (i,x) 
such that Fle^a = fif and hence either W(z) = Wi(z) and the inequality follows from ((77)) . 
or ty(z) = Wj(z) where j is an index for which CASE 2 applies and therefore the inequality 
follows from (|8"3"|) . 

To conclude the proof it remains to verify that (|89p extends to (|3^|) in points where VW is 
not defined. First, observe that points £ where W is not differentiable are characterized by the 
set 

x(0 = {<e{i, •••,?} ; w(0 = wi(o} 

containing more than one element, and thus any singular point belongs to one or more hypcr- 
plancs Hij of the form (|81l) . for i ^ j and i, j £ 1(C)- Now, fix x such that I(x) contains 
multiple indices and assume U(x) = u| for a suitable pair (£,j), the control m| £ U being as 
in (|76p . Considering again that VF is the minimum of the finite family of quadratic functions 
Wi, . . . , W q , it is easy to verify that there exists 5 > and l £ I(x) such that for S £ ]0, S[ 

W(x + Sf(x,ul)) = W L (x + 5f{x,u])) 

and thus f(x,u^)*W(x) = f(x, u|) • W t {x) = \7W L (x) -/(.t,w|). 

Now, if i is an index such that CASE 1 (|82p happens, then we claim it must be 1 = j and 
thus ([77)1 gives 

/(x, m|) • H^(x) = VWj (x) ■ f(x, uj) < -h(x) + e/2 . 
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Indeed, if it were i ^ j, we would have x <E d^DHj L and the strict inward pointing condition (j52")l 
would imply that for 5 small enough 

W{x + 5f{x,u]))=W j {x + 5f{x,ufj) <W,(x + 5f{x,u])), 

which in turn contradicts the choice of l. 

Finally, if l is an index such that CASE 2 (|83"f happens, then x £ Vt^C\'Hj b and (|55|) itself ensures 
f{x,u]) • W{x) = VW,(x) • /(x,u|) < -h(x) + e . 

Step 9. We now want to prove that it is possible to find a > and a subcollection of open 
domains extracted from {^e,a}(e,a)£A with the properties required in Remark 13.21 By taking 
a > to be the constant in (|86[) . the definition of the "slices" C m in the remark coincides with 
the one given in Step 7, for m = 0, . . . , N — 1. Fix a compact set K C A \ £ and assume that 
the domains used for the patches of U satisfy diam5l£ jQ < A' for all (£, a). Then, we set for any 
m = 0, . . . , N - 1 

1m ={/3= (m, a )sA; Q m , a n # ^ 0} , 

JV-l 

/3 m = min j3, B = (J 2„, . 

m m=0 

We know that each I m has finite cardinality because the lens-shaped domains f2 m .a were a 
finite covering of C m (see again Step 7 above). Hence, it follows immediately that the indices 
/3 m arc well defined, that they increase when m increases and that 

KnC m Q |J n^, Vme {0,...,N-1}. 

Also, it is easy to verify that (i) holds, given that the sets {£le, a } formed a covering of A \ £ 
and that diamf^ :Q , < A'. Hence, it remains to show that (|4U|) is verified. But we have already 
proved in Step 7 that, on each Q m ,a = Qf, can violate the inward-pointing condition 

only in points of d~£lf and that these points belong to U m '>m Therefore, (|4"U)) holds and 
the proof is complete, o 
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